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Abstract 


This paper presents the results of a study on the use of the delta 
modulator as a digital encoder of television signals. . The study began 
with the computer simulation of different delta modulators in order to 
find a satisfactory delta modulator. After finding a suitable delta 
modulator algorithm via computer simulation, we analyzed the results, 
and then implemented it in hardware to study its ability to encode real 
time motion pictures from an NTSC format.television camera. 

We then investigated the effects of channel errors on the delta 
modulated video signal and tested several error correction algorithms 
via computer simulation. A very high speed delta modulator was built 
(out of ECL logic), incorporating the most promising of the correction 
schemes, so that it could be tested on real time motion pictures. 

' The final area of investigation concerned itself with finding delta 

modulators which could achieve significant bandwidth reduction without 

regard to complexity or speed. The first such scheme to be investigated 

was a real time ’’frame to frame" encoding scheme which required the 

assembly of fourteen, 131, 000 bit long shift registers as well as a high 

speed delta modulator. The other schemes involved the computer simu- 

> 

lation of two dimensional delta modulator algorithms. 
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Introduction 

Developments that have taken place over the past ten years clearly show a trend 
toward digital processing of communication signals. Already voice signals and 
computer data are being processed digitally in many systems, but digitization of 
television signals lias achieved only limited acceptance. There are two reasons 
for the lack of applications for the digital transmission of television signals. First, 
a cheap, high speed, binary, digital encoder that can accommodate the large band- 
widths required for television signals is not available, and secondly, those systems 
that are relatively cheap, such as DPCM and PCM increase the already-large band- 
width of television signals by a factor of between three and eight. A binary, digital 
encoding technique which may overcome some of these difficulties is the delta modula- 
tor. 

This paper presents the results of a study on the use of the delta modulator as 
a digital encoder of television signals. The study began with the computer simulation 
of different delta modulators in order to find a satisfactory delta modulator. A satis- 
factory delta modulator was one that could operate at the very high sampling rates 
required for real time processing of television signals, and could also provide a bit 
rate reduction over PCM digital encoding techniques. After finding a suitable delta 
modulator algorithm via computer simulation, we analyzed- the results, and then 
implemented it in hardware to study its ability to encode real time motion pictures 
from an NTSC format television camera. 

We .than investigated the effects of channel errors on the delta modulated video 
signal and tested several error correction algorithms via computer simulation. A 
very high speed delta modulator was built (out of EC.L logic), incorporating the most 
promising of the correction schemes, so that it could be tested on real time motion 
pictures. 

The final area of investigation concerned- itself with finding delta modulators 
wMeh could achieve signifieant bandwidth reduction without regard to complexity 
or speed. The first such scheme to be investigated was a real time "frame to frame 11 



encoding scheme which required the assembly of fourteen, 131, 000 bit long shift 
registers as well as a high speed delta modulator. The other schemes involved 
the computer simulation of two dimensional delta modulator algorithms. 

The Delta Modulator 

The delta -modulator chosen to encode the pictures in this paper is shown -in 
Fig 1. The equations describing the operations of the delta modulator are given 
below: 


E k = SgU ( S k“^ 
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X =12 Y . E. 




mm k 
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V max 
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min* 
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k 1 

max 


max 


= Output of the encoder 
S^. = Input to the encoder 

Y, = The encoder's estimate of the input signal at the k^ 1 

"til 

instant of time; also, the decoder's output at the k 
instant of time 

Y^ = The step size of the delta, modulator 

Y . , Y s Constants, that determine the minimum and 
man max 

maximum allowable value for Y, 


a, 3 = Other constants 
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There are other delta modulator algorithms besides the one described by 
Eq 1, 2 and 3. In general the differences lie in Eq 3, the way the step size is 
formed ■> 3h some delta modulators | Y^ | is a constant. In others it increases 
or decreases linearly. In our delta modulator the step size, Y^, changes ex- 
ponentially. It has been experimentally determined that an exponentially 
changing step size type of delta modulator is more appropriate then the' other- 
types of delta modulators at encoding a signal with large step type changes in. 
amplitude as found in video signals. 

In order to test our delta modulator on video signals from actual pictures, 
and to find good values for a, 8, Y . and Y (see Eq 3) we set up a computer 

H im iHctx i 

processor for pictures as shown in Fig 2. With the experimental aparatus of 
Fig 2 we were able to program the PDP 8 computer to simulate a delta modulator. 

By varying the values of a, 6, and Y max in the computer program, and then 

comparing the resulting pictures, we obtained values for a, 8, and 

which would produce satisfactory pictures. 

fa choosing the best set of values for a, 8 we also considered the effects of 
different sets of values on a real time hardware implementation of the delta modula- 
tor. Since very high sampling rates would be required for the real time processing 
of video signals, we restricted our choice of values of a and ,6 to those values that 
would minimize the time required to perform the multiplications of | Y^ [ by. a 
and 8. From the computer simulations we found that a = 1 and Q — . 5 produce 
about the best pictures. Since these values are also powers of 2 the multiplica- 
tion by 1 and . 5 are wired shift operations and require no hardware to implement 
nor any time to perform. Clearly, a — 1 and ,8 - . 5 was an ideal choice for a and 
,6 and thus these values were used in all our delta modulators. 

To determine the effects of Y . and Y on a delta modulated encoded picture 

min max 

we examined the response of the delta modulator to a step like input. We chose a 
step like input because the edges of objects in pictures produce step like changes in 
the video signal. From Fig 3 we see that at first the delta modulator's output does 
not rise as fast as the input signal. This effect gives rise to a type of degradation 
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called slope overload noise. After the delta modulator catches up with the input 

signal it may overshoot the input, and then after a period of time known as the 

settling time, the delta modulator settles down to a repetitive four bit pattern 

that bounces around the input signal. This last effect is a type of degradation 

often called granular noise. The amplitude of the granular noise determines 

the minimum voltage change of the input signal that can be resolved by the delta. 

modulator. Note also that when the step size, Y^, increases, it increases by a 

factor of 1.5 until Y is reached. When the step size decreases, it decreases 

max 

by a factor of . 5 until is reached. This, of course, follows from. Eq 3 and 
a = 1, /3 = ,5. 

Table 1 sumarizes the relationship between slope overload noise, granular 

noise, overshoot, settling time and increasing or decreasing the value of Y 

min 

and ^itnax* ^ rom 1 & is clear that a tradeoff exists between slope overload 

noise and granular noise when choosing a value for Y . . For Y ' the tradeoff 

min max 

is between slope overload noise against settling time and overshoot amplitude. 

From our computer simulations on real pictures we found that a value for Y 

min 

equal to 1/64 the peak to peak video input signal produced the best pictures. This 

result is not surprising since this value of Y . will allow the delta modulator to 

mm 

resolve 64 gray levels and it is well known that at least 64 gray levels are required 

to produce satisfactory pictures. It was also found that the quality of our pictures 

was not very sensitive to the value of Y .It was observed that the value of 

max 

^k rare ty grew larger than 1/4 the peak to peak input signal and that large overshoots 

and ringing usually produced out of band frequency components that were e liminat ed 

by low pass filtering. After considering all factors we chose a value of 1 /4 the peak 

to peak input signal for Y 

max 

In conclusion we found that the delta modulator worked best with a = 1, 8 = .5 , 
^min = V64 p- p input signal and Y m ^ y = 1/4 p - p input signal. ’ These values 
were used in all subsequent delta modulators. 



Slope 

Overload Noise 

Increasing Y . Decreases 

Decreasing Y^ Increases 


Increasing Y Decreases 

max 

Decreasing Y Increases 

& max 


Table I 
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No Change Increases Increases 

, No Change Decreases Decreases 
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PCM vs. Delta Modulated Pictures 

In Fig 4 a comparison can be made between delta modulated pictures and 64 
quantization level PCM encoded pictures. The pictures were taken using the experi- 
mental setup shown in Fig 2. Note that at high bit rates (682 bits/line) both PCM 
and delta modulation produce satisfactory pictures. At low bit rates (410 bit per 
line) edge business can be seen in the delta modulated pictures and a loss of 
resolution can be seen in the PCM encoded pictures. The edge business shows 
up as a wiggliness along the right edge of my face, and the loss of resolution in 
the PCM encoded pictures is apparent by the loss of the stripes on my shirt. A 
subjective evaluation of Fig 3 leads us to the conclusion that at high bit rates PCM 
encoding is desirable and at low bit rates delta modulation preserves more detail 
in the picture then PCM. 

The degrading of PCM encoded pictures at low bit rates by a loss of resolu- 
tion is completely explained by the Nyquist sampling theorem; however, the de- 
grading of delta modulated pictures at low bit rates by edge business requires further 
explanation. The solid line in Fig 5 shows the response of the delta modulator to stej; 
input The dotted line shows the response of the same delta modulator to the same 
step input but the delta modulator had different initial conditions, at the start of the 
step. In. the first case the slope overload is large and in the second case it is small. 
In a picture this would have the effect of delaying an edge sometimes, but not at 
other timeSo The resulting effect would be to cause all sharp edges at right angles 
to the direction of scan to wiggle. This effect we call edge business. 



A High, Speed Heal Time Delta Modulator 

From the computer simulations we were able to find a satisfactory delta 
modulator and investigate its behavior when encoding a single frame of a still 
picture. In order to investigate the behavior of the delta modulator on motion 
pictures it became necessary to build a high speed delta modulator which could 
encode pictures from an NTSC standard TV camera in real time. 

The block diagram for the high speed video delta modulator is shown in 
Fig 6. The two flip-flops on the top of the diagram store and . The 
upper adder /substractor, register, multiplexor and "OR !l gate implement Eq3. 

The lower adder/substractor and register carry out Eq 2, and the D/A converter 
and comparator implement Eq 1. 

The complete circuit schematic for the high speed delta modulator is shown 
in Fig 7, and in Fig 2 S' (top left picture) the component side of the circuit board is 
shown. The delta modulator contains 16 Schotky TLL integrated circuits, two high 
speed D/A converters, and a high speed comparator. 

When constructing a very high speed digital and analog system such as shown 
in Fig 7 it is necessary to adhere to certain construction practices or else ‘'switch- 
ing gliches", ringing, and oscillations may degrade the performance of the system. 
Some of the construction practices we used are listed below: 

1) Bread board the unit on a double sided copper clad board. Use the lower 
’ copper side as a ground plane along which all wires are run. The upper 

copper side may be used as a power buss. 

2) Put bypass capacitors between the power buss and the ground plane. It 
may be necessary to put bypass capacitors at every IC. 

3) Isolate, the analog portion of the system (D/A converter and comparator) 
from the switching noise of the digital section by providing separate bypass 
capacitors for all analog devices’ power input pins. 

. 4) High speed comparators love to oscillate as they pass thru their linear 
region of operation. To prevent this, keep the input. and output wires 
short, far apart, and if possible shielded. 
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5) Keep all wires as short as possible to prevent stray inductance and 
capacitance from causing ringing on the logic signals which might 
cause retriggering of the logic gates. . 

The high speed delta modulator was tested using the experimental setup 
shown in Fig 8. The setup funtioned in the following manner: A scene from a 
slide was converted to a video signal by the TV camera. The video signal was 
band limited by an adjustable cutoff low pass filter whose output provided the 
input to the delta modulator. The delta modulator was then clocked at its maxi- 
mum rate of 10 MHz, The output of the delta modulator feeds another adjustable 
low pass filter whose cutoff is set to the same frequency as the previous filter. 

The processed picture is then displayed on a monitor and photographed. Sync 
for the camera and monitor is supplied by a separate sync generator. A switch 
is also provided so that a quick comparison can be made between the delta modulated 
encoded video signal and the unencoded video signal. 

The output from the delta modulator used in Fig 8 was the test output marked 
on the diagrams of Fig 6 and 7 . This output, in the absence of channel errors is 
the same as the output of the delta modulator receiver shown in Fig 1. This 
property made it unnecessary to build a receiver in order to test the delta modu- 
lator's ability to encode a video signal in the absence of channel errors. 

The pictures in Fig 9 are representative of the quality of the pictures that 
we obtained from the test setup of Fig 8. The pictures on the left half of the page 
have been delta modulated while those on the right are the originals. The fact 
that the pictures on the right appear to be blurred is not due to bad photography, 
but is a consequence of low pass filtering the video signal. The bandwidth of the 
pictures, as determined by the settings on the filters of Fig 8, are given as follows: 
upper row, 2 MHz; middle row, 1.5 MHz; and lower .row 1 MHz. 

Since the pictures in Fig 9 have frozen a single frame from the 30 frames 
per second TV camera and monitor, some effects of real time processing are 
not shown in the "frozen scenes" of Fig 9. I will therefore try to describe these 



9 ) 


effects » In Fig 9, upper left hand corner, edge business can can clearly be seen 
on the edges of vertical objects. The edge businesss appears as a slight horizontal 
displacement of each scanning line about the edge. Because some lines appear to 
be displaced more than others, straight vertical edges become wiggled as shown 
in Figl 'A . Now, imagine that sucessive frames of the same scene are flashed at 
the eye and each frame has its own wiggle pattern, as is the case with the real 
time processor, then the eye will see the edges flutter in time. This fluttering 
appears as a shimmering on the edges of objects. Although the shimmering is 
hoticable it does not seem to cause a lose of resolution in the pictures and it is 
no more annoying then the edge business seen in Fig ?. 

Just as the effect of viewing successive frames of a still picture cannot be 
seen in Fig 9, nor. can the effect of the TV camera viewing a changing scene be 
determined from Fig 9. To determine the effect of the delta modulator on the 
video signal from a moving scene, we removed the slide projector from Fig 8 and 
a im ed the camera at a room full of people at a party. The delta modulator showed 
no new land of degradation for the moving scene. In fact, moving objects suffered 
slightly less edge business then still objects because the eye does not see moving 
objects very clearly. 

If we assume that the pictures on the right in Fig 9 were encoded using 64 
level PCM (sampling at the Nyquist rate) then we can calculate and compare the 
bit rate, and the number of bits per pixel for the pictures on the right with those 
on the left of Fig 9 from the following equations 

Bits ~ (Sampling Bate) (Bits Per Sample) 

Pixel 2 x Picture Bandwidth 

Bit Rate = (Sampling Rate) (Bits Per Sample) 


(Eq 4) 


(Eq 5) 
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This yields : 


Table II 


Picture 

. Delta Modulator 

PCM 



bit 

bits per 

bit 

bits per 


rate 

pixel 

rate 

pixel 

TOP 

10 MHz 

2.5 

24 MHz 

6 

MIDDLE 

10 MHz 

3.3 

18 MHz 

6 

BOTTOM 

10 MHz 

5.0 

12 MHz 

6 


From the values in Table 31, the pictures in Fig 9, as well as motion picture 
observations, we have concluded that our real time delta modulator can compress 
the bit rate over PCM by a factor of between 2 to 3 without any loss of detail. 
Although no loss of detail is observed it is clear that the pictures in the left 
eolumn are degraded over those in the right column of Fig 9. The degradation 
is most severe for the top row where the bit rate compression is 2. 5 and almost 
unnoticable in the bottom row where the bit rate compression is 1. 2. 
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The Effects of Channel Errors on the Delta Modulated Signals 

When transmitting signals over real channels it is necessary to consider the 
effects of channel errors. The next section of this report explains the effects 
of channel errors on the delta modulated video signal and explores several error 
correction algorithms. 

The response of the delta modulator decoder to a step input at the encoder 
in the presence of a single channel error is shown in Fig 10. The solid lines 
represent the output signal, X^, of the decoder in the absence of channel errors, 
while the dashed lines represent the output signal of the decoder in the presence 
of a single channel error. 

Channel errors have two effects on the delta modulator. The first and 
most obvious effect that can be seen in Fig 10 is that channel errors always 
cause a permanent, and usually large DC shift in the received signal. Less 
obvious is the fact that a single channel error may cause an increase, decrease 
or have no effect at all on the step size of the delta modulator decoder, and less 
obvious still, is the fact that step size errors, when they occur, become self 
correcting within a few samples. Because step size errors last for only a few 
samples, and delta modulators typically sample at several times the nyquist 
rate of the input signal, the disturbance caused by step size errors is usually 
one to two pixels long and can~bearly be perceived in the picture. 

We have both quantitative results and experimental evidence to support the 

statements made in the preceeding paragraph. The quantitative results were 

arrived at through the following process. Observe from Fig 10 and Eqs 1, 2 

and 3 that the step size, Y^, will decrease while the delta modulator is tracking 

a constant DC level. If the constant signal level persists long enough the delta 

modulator reaches the minimum step size, Y . , whether or not a channel error 

min 

has occured. When the delta modulator reaches the minimum step-size, the step 
size error has corrected itself, since both the corrupted signal and the ideal error 
free signal would have the same step size namely Y . , the minimum step size. 
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The number of transmitted bits, N, that will reach the receiver after the 
occurrence of a ch ann el error, but before the step size corrects itself, has an 
upper bound for the delta modulator tracking a constant DC level. This upper 
bound can be shown to be 

• 75 N / 2 "W \ +1 

2 lB W Y k + i 
° r N=_ X775 


where N = the number of transmitted bits until step size correction occurs 

sthe step size one sample time after the occurrence of the error 

Y . = the minimum allowable value for Y, . 
mm k 

For the pictures in this paper the worst case parameters for Eq 6 are 

Y = 1 and Y, „ = 16 which yield a worst case N = 19. If the delta modulator 
mm k+1 

samples at six times the nyquest rate of the video signal then the step size 
error should last for less that 3 pixels if the conditions imposed in deriving 
Eq 4 hold for a real picture. 

The series of pictures in Fig 11 were taken to confirm the results of 
Eq 6, i.e. , step size errors quickly correct themselves, and to confirm 
that channel errors cause a. large permanent shift in the DC level of the 
output of the delta modulator. Figure 11a shows the original picture without 
any errors. In Fig lib channel errors were introduced at a rate of one error 
for every 2, 500 transmitted bits. From Fig lib we see that each channel 
error caused a shift in the level of the decoders output signal. This shift, 
seen as a streak, lasts until the end of the scanning line where the effect of 
the error is ended by resetting all the registers in the encoder and decoder 
to a fixed predetermined value. In Fig 11c we have displayed the absolute 
value of the step size without any channel errors and in Fig lid we introduced 
channel errors. Figure lie is the difference between Fig 11c and Fig lid. 
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The uniform gray background in -Fig lie represents zero difference between 
Fig 11c and/Fig lid or equivently, no step size error. The white and black dots 
are the regions where the difference between Fig 11c and Fig lid was not zero 
or equivently, where a step size error exists. Figure lie confirms the fact 
that step size errors become self correcting after a few samples. The con- 
clusions that we have drawn from our studies of the effects of channel errors 
on delta modulated video signals is that channel errors have a significent effect 
only on the DC level of the estimate, X^, of the delta modulator decoder and 
that error correcting schemes need only correct for errors in the decoder's 
estimate, X^. 

Error Correcting Algorithms 

The preceeding analysis has revealed that channel errors effect delta 
modulated encoded video signals by changing the DC level of the decoded 
signal. In the rest of this paper we will describe three techniques to 
minimize this effect. 

Direct Approach 

It is possible to correct the DC level of the decoders estimate by 
periodically sending the transmitters current estimate, X^, to the receiver. 

The effect of this correction technique, (shown in Fig 12) is to shorten the 
length of the error streaks. The more often the transmitters estimate is 
sent to the receiver the shorter the streaks become. Unfortunately the 
more often we send the transmitters estimate, the more we must increase 
the transmission rate to accommodate this extra information. 

The equation that relates the several parameters that determine the 
increase in transmission rate is given by Eq 7. 
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V " f d 


+ — ) 
s ’ 


•,(7) 


where 

f ' = The bit rate with correction 
s 

f = The bit rate without correction 

c = The number of times is sent to the receiver per frame 
b = The number of bits in each X^. sent to the receiver 
s = The total number of E^ ,s transmitted per frame 

Prom Eq 7 it is apparent that "c" and "b" should be as small as possible. 

"c" is lower bounded by the desired degree of correction required in the 
picture since the length of the remaining error steaks in the received 
picture are inversely proportional to c, and b is lower bounded by the 
accuracy of the correction. 

To understand the effect of "b" on the correction algorithm refer to 
Pig 13. Figure 13 shows how the correction algorithm is implimented. First 
the "b" most significent bits of the transmitters estimate are sent to the re- 
ceiver via a PCM format. Upon receiving the PCM word the receiver sets the 
"b" most significent bits in its estimate equal to the transmitters estimate. 

Then both the transmitter and receiver set their b +.1 most significent bit to 
1 and all less significent bits to zero. The total effect is to make the transmitter's 
and receiver's estimate equal, and to introduce an inaccuracy in the estimates 
equal to 2 ^ * percent. 

The effect of the inaccuracy in the estimates introduced by the correction 
algorithm is shown in Fig 14. Note that the effect is transient and is completely 
undetectable for b = 4. The value b - 4 was used in the pictures of Fig 12. 



Leaky Integrator 

The effects of channel errors on delta modulated encoded pictures can be 
m ini m ized by introducing leaky integrators in the feed back loop of the encoder 
and in the decoder. Leaky integration is achieved by introducing the factor L, 
(L< 1), into Eq 2 as shown in Eq 8. 


X K=1 = “K + Y K + 1 


If a channel error causes the estimate, X^., to become shifted by an 
amount M e" at time "k”, then at time K + N Eq 8 will become 


N - 

N 3Si-i Isr 

X K + N" LX K + g 1 L Y K + 1 +Le 


From Eq 9 we see that the error "e" will leak away by the factor L, 

N 

and after N samples the amplitude of the error will be L e. Clearly, the 
smaller the value of L the sooner the error will disappear. The smallest 
value of L that may be used without degrading a picture with 64 quantization 
levels ranging from -32 to +31 is L = . 967. 

Figure 15 shows the effect of using a leaky integrator with L = . 967 on 
delta modulated encoded pictures that were transmitted over a noisy channel. 
From Fig 15 we see that the inclusion of leaky integration in our delta modulator 
will substantially reduce the effects of channel errors on the received pictures. 
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Line to Line Correlation 

In this section we will explain a technique, shown in Fig 16, which locates 
error streaks in pictures and which then eliminates the streaks by readjusting 
the DC level of the streak to its proper value. 

■ To detect an error streak in a picture a comparison is made between the 
DC level of the portion of a scan line under test and the corresponding portion 
of the scan line above and below the line under test. If the DC level of the 
portion of the line under test differs from both the line above and below by 
more than a certain "threshold" then an error has been detected. When an 
error is detected the DC level of the portion of the line under test is replaced 
by the average DC value of the corresponding portion of the line above and 
below. The part of the picture referred to as "the portion under test" is 
formed from 1 ‘N 1 1 consective samples on a scanning line. 

There are two parameters in the above algorithm that must be adjusted, 

"N" and the "threshold", to eliminate the error streaks. In Fig 17 we can 
see the effects of "N" and the "threshold" on both the error streaks and the 
quality of the picture. Small values of "N" and low thresholds eliminate 
the error streaks but they tend to degrade the picture by eliminating thin 
objects such as the bottom of my glasses as shown in Fig 17e. Large values 
of "N" and high thresholds leave some error streaks undetected and parts of 
others uncorreeted but they do not degrade the picture. It is our opinion that 
Fig 17c represents the best compromise between the degree of error correction 
necessary and the amount of degradation that can be tolerated in the picture. 
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High Speed Delta Modulator With Error Correction 

It was necessary to implement one of the error correction schemes on a 
real time delta modulator to enable us to see the. effects of the 30 frame/sec 
real time frame rate on the visibility of channel errors after error correction. 

The leaky integrator method of error correction was chosen for our delta 
modulator. The following four reasons are given for our decision to use the 
leaky integrator error correction technique. 

• 1) The leaky integrator did not increase the signal bandwidth. 

2) The leaky integrator did not degrade the picture as line to line 

• - interpolation could. 

.3) The leaky integrator was the simplest to implement at high speeds. 

4) The leaky integrator -corrected channel errors in the computer, 
simulations as well as the other two methods- tested. 

The circuit schematic for the delta modulator is shown in Fig 1 $. The 
delta modulator is built out of MECL 10, 000 series logic and will operate at a 
15 MHz clock rate. Figure 18 shows only the delta modulator transmitter; 
however, the receiver is just the feedback loop of the transmitter as is shown 
in Fig 1. From Eq 8, shown again below, it is clear that the leaky integrator 
correction scheme is implemented by multiplying the leak factor L by X^. 

X K + r= LX K* Y K + l < 10 > 

If the .leak factor is chosen such that it can be written in the form below with h. 
an integer 


L = 1 - 2“ n 


( 11 ) 


then we have 


x k + i =x k- 2 '“ x k + y k + i 


( 12 ) 



and the multiplication by L becomes a substruction of by shifted n places 
to the right. The circuit schematic of Fig 18 is drawn for n = 6; however, we 
also plan to test the delta modulator with n = 5. From the computer simulations 
we already know that n = 5 or 6 will give the best results. 

• A problem arises in the implementation of the leaky integrator multiplica- 
tion algorithm because is a 6 bit wide binary number and the multiplication 
algorithm yields a number for L X equal to 6 + n bits wide. Rather than save 
all 6 + n bits and significantly increase the amount of hardware in the delta 
modulator we truncated L X T , at 8 bits wide. This truncation results in the 
inability of errors to completely leak away. The error will leak until the 
difference between the estimate in the transmitter and receiver is 1 /4 the peak 
to peak signal for n = 6 and 1/8 the peak to peak signal for n = 5. 

To prevent the residual error that does not leak away from being propagated 
indefinately, circuitry is included in Fig 18 to reset the delta modulator's estimate 
and step size registers, in both the transmitter and receiver to a zero value at the 
end of every scan line. The end of the scan line is detected from the composite 
video signal by setting a comparator to flip on the negative sync pulse. The re- 
setting of the estimate and step size registers occurs on the first positive bit 
(e ) generated by the transmitter after the sync pulse is detected. This guarantees 

K 

that the transmitter and receiver reset their registers at the same time which is 
necessary to prevent the resetting algorithm from introducing its own errors. 

Figure 1^ shows the test setup used to test the delta modulator. Note that 
channel errors are introduced between the transmitter and receiver. Note also 
that the sync signals are generated internally by the TV camera and reach the 
monitor via the composite video signal. 

JThe delta modulator in Fig 18 is currently being I 

( built. We expect to have some results by September 1976. 1 
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High Speed Frame to Frame Delta Modulation 

From the previous work presented in this report it is apparent that the 
key to producing high quality picture, at low bit rates, with delta modulation, 
lies in reducing edge business. In this section of the report we explain a 
frame to frame encoding technique employing a delta modulator which will 
reduce edge business in real time motion pictures. 

Successive frames of a motion picture contain redundant information. 

The amount cf redundancy depends upon the degree of change in the scene from 
frame to frame. It has been found that for picturephone application on the 
average, only 9 percent of the picture changes from frame to frame 
For broadcast television service about 10% of the picture changes from frame to 
frame ' .. It is also known from the psychophysics of vision that the 

more rapid the motion from frame to frame of the image, the more difficult is 
the resolving of image detail for the observer. It is possible to design a delta 
modulator which will produce good pictures at low bit rates by taking advantage 
of the interframe redundancy of pictures and the psychophysical property of 
vision mentioned above. 

Figure 20 shows the encoding scheme - that the frame to frame delta modu- 
lator will use. Each large square represents a successive frame of a motion 
picture. Each dot on a frame represents a pel (picture element). Note that each 
pel has associated with it a delta modulator (A MOD) that follows the same pel 
through successive frames. Thus the AMOD in the upper most left hand corner 
always encodes the pel in the upper most left hand corner for every frame. 

The encoding of high quality pictures at a low bit rate is achieved in the 
following manner. From previous studies of delta modulators it has been ob- 
served that high sampling rates are required for a delta, modulator to accurately 
encode rapidly changing signals and low sampling rates may he used on slowly 
varying signals. The usual method of encoding a picture by sampling successive 
pels within the same frame results in rapidly changing signals which require a 
high delta modulator bit rate. With the frame to frame encoding technique of 
Fig 2 0 each delta modulator is associated with its own pel. On the average, 90% 
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of the pels will not change value from frame to frame, allowing the delta 
modulator to accurately encode the value of the pel at a low hit rate. Of course, 
those pels that do change value will not he encoded accurately, but the eye will 
not see the inaccuracy if the pel was associated with rapid motion. Using this 
scheme motion pictures will he encoded at 1 bit per pel. 

At first thought, hardware implementation of Fig 10 may seem impossible 
since, at one delta modulator per pel, a typical 200, 000 pel/frame 3 MHz band- 
width TV system would have to contain 200, 000 delta modulators each operating 
at a 8 MHz sampling rate. Fortunately only one 6 MHz delta modulator need be 
used to implement Fig^O; however, this single delta modulator will have to 
contain enough shift register type memory to store an entire picture frame. 

The reason that one delta modulator can replace all the delta modulators 
of Fig 1 0 with no increase in operating speed is simple. If Fig ZQ was implemented 
as shown all 200, 000 pels could be encoded, decoded and displayed in parallel, but 
a real time television system requires only one pel at a time in serial. The retention 
time of the eye and screen give the appearance of a full picture. We may take ad- 
vantage of this by starting a single delta modulator at the upper most left hand corner 
of a frame, let it encode that pel based upon its previous estimate of the pel from the 
previous frame, tr an s mit a bit (E^.), store its new estimate (X ) for that pel, and 
then repeat the process for the next adjacent pel in the same frame. The delta modu- 
lator will continue to encode, and transmit for each adjacent pel in turn, until the 
delta modulator has been multiplexed through the entire frame (typically 1/30 sec). 
Then the delta modulator will return to the first pel and repeat the process for the 
next frame. 

Figure 2 I shows the block diagram of the frame to frame delta modulator. 

This delta modulator is the same as the one shown in Fig 6 except for the addition 
of fourteen 131, 000 bit long shift registers. The shift registers were assembled out 
of Intel's 2107 4K dynamic random access memories. ' • • 

The following paragraph- gives a brief explanation of how the random access 
memories were assembled into shift registers. The memory chips were paired as 
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shown in Fig 22 to produce two hundred and twenty Tour, 8, 195 bit long shift 
registers. A memory can be turned into a shift register by sequenially 
addressing the memory, one memory location for each read-modify-write 
cycle of the memory. In this way the memory appeal's to shift all the data 
bits one place to the right (just like a shift register does) for each memory 
cycle. Since the read-modify-write cycle of these memories takes 1 (as, 
the maximum shift rate of the 8, 195 bit long shift register was only 1 MHz. 
To achieve a minimum 6 MHz shift rate required for real time processing, 
sixteen of the 8,195 bit long shift registers were cascaded by two and multi- 
plexed by eight as shown in Fig 23 to produce one 131,120 bit long 8 MHz 
shift rate shift register. Timing signals and syncronization were provided 
by the circuits shown in Fig 1 H and 2S. Pictures of the circuit boards can 
be seen in Fig 2 €. 

vat 

The hardware for the frame to frame delta modulator 
is not yet complete. We hope to complete the unit 
and obtain results by September 1976. 
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Two Dimensional Delta Modulators 

We are developing two dimensional delta modulator algorithms to encode 
video signals. Preliminary results suggest that pictures encoded by these two 
dimensional delta modulators will not suffer as severely from edge business 
as do pictures encoded by one dimensional delta modulators. 

At the present time we are investigating several types of two dimensional 
delta modulators. One type under investigation consists of two* one dimensional 
delta modulators such that one delta modulator scans the picture horizontally, 
while the other scans the picture vertically. The two delta modulators interacted 
at every picture element to -produce a combined estimate of the picture and a single 
one. bit output for each picture element in the picture. The defining equations' for 
the delta modulator are: 


Output Equations 


E k = fflgn 




V, 


Estimate Equations 

H H H 
" LX k-i + *i< 
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Step Size Equations 
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= One bit wide output of the two dimensional delta modulator 
= k . sample of the input picture 

p 

X.£ = The two dimensional delta modulator’s estimate of the picture 
H 

Xg. = The horizontally scanned delta modulator's estimate of the picture 

V 

X K = The vertically scanned delta modulator's estimate of the picture 
H 

Yg. = The horizontally scanned delta modulator’s step size 

V 

Yg. = The vertically scanned delta modulator's step size 

n - The number of samples in a scanning line of the picture 

a, b, L = Constants which are 'experimentally adjusted to optimize the delta 
modulated encoded picture 

In Fig 27 a one dimensional delta modulator is compared with a two 
dimensional delta modulator. Although the picture encoded with the two 
dimensional delta modulator is unsatisfactory due to "corner effects" the 
a l m ost complete lack of edge business on horizontal and vertical edges, 
suggests that this approach to two dimensional delta modulation if investigated 
further might be modified to yield satisfactory pictures. It has been suggested 
that a third delta modulator scanning diagonally (the other two scan horizontally 
and vertically) may eliminate the corner effect, or even a modification of the 
step size equation may help. 
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FIG. .2 COMPUTER PROCESSOR FOR PICTURES 











DELTA MOD M2 BITS/ LINE 



DELTA MOD 512 BITS/ LINE 



DELTA MOD 410 BITS/LINE 



PCM G82 BITS/ LINE 



PCM 512 BITS/LINE 



PCM 410 BITS/LINE 


Fic;. 4 A comparison of an adaptive delta modulator and a PCM encoder of 
video signals; 170 scaning lines per picture; PCM pictures have 64 
quantization levels. 
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Fig. 5 Response of the Delta Modulator to a Step Input 
with Different initial Conditions 
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Fig. 9 A comparision of delta modulated pictures (left column) and 
unencoded pictures (right column) from a real time NTSC 
TV camera; Top row, 2MH^ bandwidth; Middle row, 1.5MH 
Bottom row, 1MH Z ^ TT Tfrv TttE 
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(a) (b) 


Fig. 9a The effects of edge business on an edge 

(a) Edge before delta mod encoding 

(b) Edge after delta mod encoding 
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Fig. 10 The effects of a single channel error on 
the output of the delta modulator 

(a) No change in step size 

(b) Decrease in step size 

(c) Increase in step size 



(e) 


Fig. 1 1 The effects of chanucl errors on delta modulated encoded pictures, 
(a) Delta modulated picture without channel errors; 682 hits /line, 
170 lines, (b) Error rate of 4x1 0" 4 . (c) Aboslutc value of A k 
(d) Absolute value of with chanuel errors (c) Difference between 
(c) and (d), i.e. step size errors. 



(a) Nosiy picture; 3x10 ^ error 
rate; 1024 bits/line; 170 lines. 



(b) 4 corrections per line; 1.5% 
increase in bit rate. 



(c) 8 corrections per line? 3% 
increase in bit rate. 


(d) 16 corrections per line; 
6% increase in bit rate. 


Fig. 1 2 The effect of sending the encoders estimate to the decoder to acheive 
error correction. 
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RS.I J Error correction is achieved by seodin- the "b" most 

significant bite oi the transmitter's estimate to the roeeiver. 
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(c) b = 3 



(d) b = 4 


Fig. 1 4 


Tlie effect of sending only the "b" most significent bits of the encoders 
estimate to the decoder for error correction. 
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( a ) ( b ) 


Fig. » 5 Error correction is achieved by the use of a leaky integrator. • 
( a ) Error rate 4 x 1CT^; 682 bits / line; 170'lines per picture 
( b ) Leaky integrator with a leak factor of 1 = . 937 
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Threshold 1/16 P-P Signal Threshold 1/32 P-P Signal 

Averaged Over 1/16 Of A Line Averaged Over 1/16 Of A Line 



Threshold 1/16 P-P Signal 
Averaged Over 1/128 Of A Line 
(e) 


(d) 



Threshold 1/32 P-P Signal 
Averaged Over 1/128 Of A Line 
(f) 


Fig 11 The results of using the line to line correlation algorithm on noisy ^ 
pictures. 1000 bits/line; 170 lines per picture; error rate of 3 x 10 
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Figo 19 Real time video processor for delta modulator 
with error correction 



















analog tNfiur 










&EPRor> 



FROM TIMING GEN . 









TV CA/ICRA 


FigoZ3 One of Fourteen; 131,000 Bit Long Shift Registers 
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FIG 2 5 8 STAGE CLOCK AND TIMING GENERATOR 













Fig. 26 Circuit boards for the frame to frame delta modulator 

Clockwise from top left: Delta modulator; Timing generator; 
One of 16 shift register boards - bottom view;Sync generator; 
Multiplexer; Shift register board-top view. 




FIG. 26 






Fig. 27 A comparision of one and two dimensional delta modulator 
picture encoders; (a) Original picture; (b) One dimensional 
delta modulator; (c) Two dimensional delta modulator 





